Characterization of Sleep Stages by Correlations in the Magnitude and Sign of Heartbeat 
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We study correlation properties of the magnitude and the sign of the increments in the time intervals between 
successive heartbeats during light sleep, deep sleep, and REM sleep using the detrended fluctuation analysis 
method. We find short-range anticorrelations in the sign time series, which are strong during deep sleep, weaker 
during light sleep and even weaker during REM sleep. In contrast, we find long-range positive correlations 
in the magnitude time series, which are strong during REM sleep and weaker during light sleep. We observe 
uncorrelated behavior for the magnitude during deep sleep. Since the magnitude series relates to the nonlinear 
properties of the original time series, while the signs series relates to the linear properties, our findings suggest 
that the nonlinear properties of the heartbeat dynamics are more pronounced during REM sleep. Thus, the sign 
and the magnitude series provide information which is useful in distinguishing between the sleep stages. 



PACS numbers: 87.19.Hh, 05.45.Tp, 87.10.+e 
I. INTRODUCTION 

Healthy sleep consists of cycles of approximately 1-2 hours 
duration. Each cycle is characterized by a sequence of sleep 
stages usually starting with light sleep, followed by deep 
sleep, and rapid eye movement (REM) sleep While the 
specific functions of the different sleep stages are not yet well 
understood, many believe that deep sleep is essential for phys- 
ical rest, while REM sleep is important for memory consoli- 
dation [|lj]. It is known that changes in the physiological pro- 
cesses are associated with circadian rhythms (wake or sleep 
state) and with different sleep stages [Q-B]]. 

Here we investigate how the heart rhythms of healthy sub- 
jects change within the different sleep stages. Typically the 
differences in cardiac dynamics during wake or sleep state, 
and during different sleep stages are reflected in the average 
and standard deviation of the interbeat interval time series 
Hq]. However, heartbeat dynamics exhibit complex behavior 
which is also characterized by long-range power-law correla- 
tions [0-^], and recent studies show that changes in cardiac 
control due to circadian rhythms or different sleep stages can 
lead to systematic changes in the correlation (scaling) proper- 
ties of the heartbeat dynamics. In particular it was found that 
the long-range correlations in heartbeat dynamics change dur- 
ing wake and sleep periods [10|, indicating different regimes 
of intrinsic neuroautonomic regulation of the cardiac dynam- 
ics, which may switch on and off with the circadian rhythms. 
Moreover, different sleep stages during nocturnal sleep were 
found to relate to a specific type of correlations in the heart- 
beat intervals [pUj, suggesting a change in the mechanism of 
cardiac regulation in the process of sleep. 

We employ a recently proposed approach of magnitude and 
sign analysis JI^ , pj[ | to further investigate how the linear and 
nonlinear properties of heartbeat dynamics change during dif- 
ferent stages of sleep. We focus on the correlations of the sign 



and the magnitude of the heartbeat increments Sti =T{ — Ti-i 
obtained from recordings of interbeat intervals r, from healthy 
subjects during sleep (Fig. 1), where i indexes each heartbeat 
interval. We apply the detrended fluctuation analysis (DFA) 
method on both the sign and the magnitude time series. We 
find that the sign series exhibits anticorrelated behavior at 
short time scales which is characterized by a correlation ex- 
ponent with smallest value for deep sleep, larger value for 
light sleep, and largest value for REM sleep. The magnitude 
series, on the other hand, exhibits uncorrelated behavior for 
deep sleep, and long-range correlations are found for light and 
REM sleep, with a larger exponent for REM sleep. The ob- 
served increase in the values of both the sign and magnitude 
correlation exponents from deep through light to REM sleep is 
systematic and significant. We also find that the values of the 
sign and magnitude exponents for REM sleep are very close 
to the values of these exponents for the wake state. 

Recent studies suggest that (i) long-range correlated behav- 
ior of the magnitude series obtained from a long-range anti- 
correlated increment series St^ relates to the nonlinear proper- 
ties of the signal, while the sign series reflects the linear prop- 
erties [ jjjyjjj ], and (ii) the increments in the heartbeat intervals 
are long-range anticorrelated [j§|] and exhibit nonlinear prop- 
erties Jl2]-|l6|]. Thus, our finding of positive power-law cor- 
relations for the magnitude of the heartbeat increments dur- 
ing REM sleep and of loss of these correlations during deep 
sleep indicates a different degree of nonlinearity in the car- 
diac dynamics associated with different sleep stages. Our re- 
sults may be useful, when combined with earlier studies of 
interbeat interval correlations in different sleep stages JTT|], 
for distinguishing the different sleep stages using electrocar- 
diogram records. 

The paper is organized as follows: In Section II we review 
the DFA method. In Section III we apply the DFA to analyze 
the sign and magnitude time series of healthy subjects. In 
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Section IV the significance of the results and interpretations 
are discussed. 



II. DETRENDED FLUCTUATION ANALYSIS 



In recent years the DFA method nrABjp Ul 1[] is becoming a 
widely-used technique for the detection of long-range correla- 
tions in noisy, nonstationary time series [^9[-p2}p[- pj| , ^3l -|3^] . 
It has successfully been applied to diverse fields such as DNA 
sequences [ p3||24| ], heart rate dynamics |^-[l3|], neuron spiking 
p^po] ], human gait p7|], long-time weather records [28 - 3Cj] , 
cloud structure [pTj ], geology [^2||, ethnolog y [|33|] , economics 
time series [jsij-pq], and solid state physics [37 38h. One rea- 



son we employ the DFA method is to avoid spurious detec- 
tion of correlations that are artifacts of nonstationarities in the 
heartbeat time series. Other techniques for the detection of 
correlations like the autocorrelation function and the power 
spectrum are not suited for nonstationary time series (see e. g. 

il). 

The DFA procedure consists of four steps. 
• Step 1: Determine the "profile" 



5> fc 

fc=i 



(i) 



of the data series Xk of length L. Subtraction of the mean (x) 
is not compulsory, since it would be eliminated by the later 
de trending in the third step. 

• Step 2: Divide the profile Y{i) into L„ = [L/n] non- 
overlapping segments of equal length n. Since the length L 
of the series is often not a multiple of the considered time 
scale n, a short part at the end of the profile may remain. In 
order not to disregard this part of the series, the same proce- 
dure is repeated starting from the opposite end. Thereby, 2L n 
segments are obtained altogether. 

• Step 3: Calculate the local trend for each of the 2L n seg- 
ments by a least-square fit of the data. Then we determine the 
variance 



n 



i=l 



[Y{{v-l)n + i)-p v (i)f 



(2) 



for each segment v, v = 1, . . . , 2L n . Here, p v {i) is the fitting 
polynomial in segment v. Linear, quadratic, cubic, or higher 
order polynomials can be used in the fitting procedure (con- 
ventionally called DFA1, DFA2, DFA3, . . .) [Q. Since the 
detrending of the time series is done by the subtraction of the 
polynomial fits from the profile, different order DFA differ in 
their capability of eliminating trends in the data. In DFAm, 
mth order DFA, trends of order m in the profile (or, equiva- 
lently, of order m — 1 in the original series) are eliminated. 
Thus a comparison of the results for different orders of DFA 
allows one to estimate the type of the polynomial trend in the 
time series [00]. 



• Step 4: Average over all segments and take the square root 
to obtain the fluctuation function [40], 



F(n) 



1 

2L, 



2L„ 



1/2 



(3) 



We are interested how F(n) depends on the time scale n. 
Hence, we have to repeat steps 2 to 4 for several time scales 
n. It is apparent that F(n) will increase with increasing n. If 
data Xi are long-range power-law correlated, F(n) increases, 
for large values of n, as a power-law, 



F(ri) 



(4) 



For long-range correlated or anticorrelated data, random walk 
theory implies that the scaling behavior of F(n) is related to 
the autocorrelation function and the power spectrum. If the 
time series is stationary, we can apply standard spectral anal- 
ysis techniques and calculate the power spectrum S(f) as a 
function of the frequency /. Then, the exponent (3 in the scal- 
ing law 

s(f) ~ r p (5) 

is related to the mean fluctuation function exponent a by 



/3 = 2a-l. 
If 0.5 < a < 1, the correlation exponent 

7 = 2 - 2a 



(6) 



(7) 



describes the decay of the autocorrelation function 

C(n) = (xi x i+n ) ~ n~i ' . (8) 

We plot F{n) as a function of n on double logarithmic 
scales and calculate a by a linear fit. For uncorrelated data, the 
profile Y (i) corresponds to the profile of a random walk, and 
(5=1/2 corresponds to the behavior of the root-mean-square 
displacement R of the walk: R(t) ~ i 1 / 2 , where t is the time 
(number of steps the walker makes). For short-range corre- 
lated data, a crossover to a — 0.5 is observed asymptotically 
for large scales n. If a power-law behavior with a < 0.5 is 
observed, the profile corresponds to anticorrelated fractional 
Brownian motion, and the data Xi are long-range anticorre- 
lated (antipersistent). Power-law behavior with a > 0.5 in- 
dicates persistent fractional Brownian motion, and the data Xi 
are positively long-range correlated. In particular, for Gaus- 
sian distributed white noise with zero mean (uncorrelated sig- 
nal), we obtain a = 0.5 from the DFA method. In addition, 
DFA can be also used to determine the scaling exponent for 
a wide variety of self-affine series, if the first step [Eq. (|l])] 
is skipped and the data are used directly instead of the pro- 
file. This way, the analysis is related to standard self-affine 
and fractal analysis. 

However, the DFA method cannot detect negative fluc- 
tuation exponents a, and it already becomes inaccurate for 
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strongly anticorrelated signals when a is close to zero. Since 
strongly anticorrelated behavior (corresponding to a w 0) 
was previously reported for the heartbeat sign series, we use 
a modified DFA technique [Q. The most simple way to an- 
alyze such data is to integrate the time series before the stan- 
dard DFA procedure. Hence, we replace the single summation 
in Eq. (jl|), which is describing the determination of the profile 
from the original data Xk, by a double summation, 



(9) 



k=l 



Following the DFA procedure as described above, we obtain 
a fluctuation function F(n) described by a scaling law as in 
Eq. fl), but with an exponent a = a + 1, 



F(n) 



(10) 



Thus, the scaling behavior can be accurately determined even 
if a is smaller than zero (but larger than —1). We note that 
F(n)/n corresponds to the conventional F(n) in Eq. (Q). If 
we do not subtract the average values in each step of the sum- 
mation in Eq. (^|), this summation leads to quadratic trends 
in the profile Y(i). In this case we must employ at least the 
second order DFA to eliminate these artificial trends. 



III. CORRELATION ANALYSIS OF SIGN AND 
MAGNITUDE TIME SERIES 

To study the correlation properties of the sign Sj = 
sgn((5ri) and magnitude m,; = | St^ | obtained from the original 
interbeat increment time series St^ we investigate in parallel 
the corresponding double profiles [see Eq. ^] for Xi = s, 
and Xi = mi. We calculate the fluctuation function F(n) by 
DFA2 for a range of time scales 4 < n < 200. The DFA2 
method turned out to be the most appropriate degree of de- 
trending in an earlier study [|TT]] . In the following we will use 
the notation a s i gn for the value a = a + 1 of the sign series 
and a mag for the value a of the magnitude series. 

We consider 24 records of interbeat intervals obtained from 
12 healthy individuals during sleep. The records have an ap- 
proximate duration of 7.5 hours. Figure 1(a) shows the heart- 
beat interval time series for a typical healthy subject with pe- 
riods of light sleep, deep sleep, REM sleep, and short interme- 
diate wake phases. The annotation and duration of the sleep 
stages were determined based on standard procedures J4l|]. 
Figure 1(b) shows a subset of the heartbeat interval series t^, 
the increment series 5^ as well as the corresponding series of 
sign Si and magnitude m, . 

In order to analyze the correlation properties during the dif- 
ferent sleep stages separately, we split each heartbeat interval 
series into subsequences corresponding to the sleep stages. 
Thus, from a typical 7.5 hour series, we obtain several sub- 
sequences of heartbeat intervals corresponding to light sleep, 
deep sleep, and REM sleep, as well as several subsequences 



corresponding to intermediate wake states. In order to elimi- 
nate the effect of transitions between subsequent sleep stages, 
and because the determination of the sleep stages is done in 
intervals of 30 seconds, we disregard the first and last 50 sec- 
onds of each individual subsequence. Then, to apply the DFA 
method, we calculate the profile for each subsequence (step 
1), cut each of these profiles into segments (step 2), and cal- 
culate the variance for each segment (step 3). In step 4, we 
calculate the fluctuation function F(n) for each sleep stage by 
averaging over all segments corresponding to (i) light sleep, 
(ii) deep sleep, and (iii) REM sleep, as well as for the inter- 
mediate wake states. 

Figure 2 shows the normalized fluctuation functions 
F(n)/n [corresponding to F(n)] versus the segment size 
(time scale) n for the sign and the magnitude for a repre- 
sentative subject. We find short-range anticorrelated behav- 
ior for the sign of the increments [Fig. 2(a)]. Our analysis 
is performed for time scales n > 7 beats — just above the 
breathing peak [Q. In the intermediate regime 7 < n < 20 
beats, we observe significant differences in the behavior of the 
fluctuation function F(n) for the different sleep stages. For 
deep sleep the F(n)/n curve bends down characterized by a 
correlation exponent a S i gn < 1, for light sleep the F{n)/n 
curve remains flat (a s i gn ~ 1), and for REM sleep F{n)/n 
increases with n (a s i gn > !)■ At n w 20, F(n)/n exhibits a 
crossover, and at larger time scales the observed anticorrela- 
tions slowly decay. For n > 100 beats, we find uncorrelated 
behavior (characterized by a S i gn = 1-5 for the profile after 
double integration) for all sleep stages. For the sign series we 
also observe that the value of the fluctuation function F(n) 
at the position of the crossover (n sa 20) is significantly dif- 
ferent for deep sleep, light sleep and REM sleep [Fig. 2(a)]. 
This observation, as well as the finding that a different corre- 
lation exponent a s i gn characterizes the behavior of F(n) for 
different sleep stages in the intermediate regime 7 < n < 20, 
could be of practical use in developing an algorithm that can 
automatically distinguish between different sleep stages based 
solely on heartbeat records. 

In Fig. 2(b) we present our results of the DFA2 method for 
the magnitude of the heartbeat increments. In contrast to the 
short-range correlations observed for the sign series, we find 
that the magnitude series for REM sleep is characterized by a 
scaling exponent a mag > 1.5 for time scales n > 10, corre- 
sponding to positive long-range power-law correlations. For 
light sleep, we find a smaller scaling exponent a mag than for 
REM sleep, indicating weaker long-range correlations. Sur- 
prisingly we find that in contrast to REM and light sleep, the 
magnitude series for deep sleep is uncorrelated, since the pro- 
file is characterized by a mag = 1.5 after the double integra- 
tion. This finding is consistent with stronger multifractality 
during REM sleep than during deep sleep [p3[], since previ- 
ous studies have related positive long-range correlations in 
the magnitude series with multifractal and nonlinear features 
present in the signal ri^B. Following Refs. [|4[^5[| we de- 
fine a time series to be linear if its scaling properties are not 
modified by randomizing its Fourier phases. In contrast, when 



3 



applied to a nonlinear series, the surrogate data test for nonlin- 
earity, which is based on Fourier phase randomization [^4 45 1, 
generates a linear series with different scaling properties for 
the magnitude series. 

The nonlinearity of a time series is related to its multifrac- 
tality. The partition function Z q (n) of a time series, Xi, may 
be defined as [Bq], 



Z q (n) = (\x l+n - Xi\ q ), 



(ID 



where (■} denotes the average over the index i. In some cases 
Z q (n) obeys scaling laws 



Z q (n) 



r(q) 



(12) 



If the exponents r(q) are linearly dependent on q the series 
Xi is monofractal, otherwise Xi is multifractal. Monofractal 
series fall under the category of linear series while multifrac- 
tal series are classified as nonlinear series [p^]. A possible 
way to test this classification is to apply the surrogate data test 
J44| , p3| ]. When this test is applied to a multifractal series, it 
generates a linear series with a linear dependence of r(q) on 
q in contrast to the nonlinear dependence for the original se- 
ries. On the other hand, applying the surrogate data test to a 
monofractal series does not affect its linear r(q) dependence. 
In [|T||l3]] 

it has been shown that the long-range correlations 
in the magnitude series indicate nonlinear behavior. Specifi- 
cally, the results suggested that the correlation exponent a mag 
of the magnitude series is a monotonically increasing function 
of the multifractal spectrum width of the original series. This 
conclusion has been obtained based upon several examples of 
artificial multifractal series [ p^ , pj| ] . 

Thus, the long-range magnitude correlations we find for 
REM sleep indicate nonlinear contributions to the heartbeat 
regulation, which are reduced during light and deep sleep. In- 
deed, a multifractal analysis of heartbeat intervals during day- 
time [|l6j indicated the presence of multifractality. In a recent 
study we also find stronger multifractality during REM sleep 
than during deep sleep [ p3| ] which is consistent with the scal- 
ing behavior of the magnitude series reported in the present 
study. 



IV. SIGNIFICANCE OF THE RESULTS AND SUMMARY 

The mean values and their standard deviations for the dif- 
ferent sleep stages are shown in Fig. 3. We estimate the ex- 
ponents a from the slopes in the log-log plot of F(n) ver- 
sus n for all records. Since the most significant differences 
for the short-range sign correlations occur in the range of 
8 < n < 13 heartbeats, we use this fitting range for the ex- 
ponents a S i gn . For the magnitude exponent a mag , we use the 
range 11 < n < 150, since the long-range correlations oc- 
curring in light and REM sleep can be observed best in this 
region. We find that there is a significant difference in the 
sign series exponent a s i gll observed for all three sleep stages 
(the p-value, obtained by the Student's i-test, is below 0.001), 



and thus we confirm the conclusions drawn from Fig. 2. The 
magnitude correlation exponents for REM sleep and for in- 
termediate wake states are significantly larger than those for 
the non-REM stages (light and deep sleep). Here also, the p- 
values are less than 0.001. Note that we do not find a signifi- 
cant difference between the average exponents for REM sleep 
and for the intermediate wake states. This is not surprising 
because heartbeat activity during REM sleep is very close to 
heartbeat activity during the wake state and the heartbeat time 
series during REM and wake exhibit similar scaling properties 
0,0]. 

More significant than the differences for the average expo- 
nents are the differences between the exponents for each indi- 
vidual. Figure 4 shows the a values for REM, light, and deep 
sleep for all 12 healthy subjects (second night only). In almost 
all cases the exponent of the REM sleep is the largest, the ex- 
ponent of the light sleep is intermediate, and the exponent of 
the deep sleep is smallest (there are three exceptions, indicated 
by arrows). In our group of 24 records from 12 healthy indi- 
viduals, we find larger exponents in REM sleep than in deep 
sleep for 100% of the sign series and for 88% of the magni- 
tude series. 

In a previous study of heartbeat records from healthy sub- 
jects during daytime activity, we found that the magnitude se- 
ries is long-range correlated, while the sign series is short- 
range anticorrelated for all subjects in the database [|l2 48 1. 
This finding suggests an empirical "rule", namely that a large 
(small) heartbeat increment in the positive direction is most 
likely to be followed by a large (small) increment in the neg- 
ative direction, and that a large (small) increment is most 
likely followed by large (small) increments. Our present re- 
sults suggest that this empirical "rule" also applies to REM 
sleep, while in deep sleep small and large increments seem to 
appear in a random fashion. On the other hand, the stronger 
sign anticorrelations in deep sleep indicate that a positive in- 
crement is more likely — even more likely than in REM sleep 
— to be followed by a negative increment. Thus, the correla- 
tion behavior of the heartbeat increments and their signs and 
magnitudes during daytime activity is similar to the behavior 
we find in REM sleep, but quite different from the behavior 
we observe in deep sleep. This is consistent with our find- 
ing [Fig. |[j of average exponent values for the wake episodes 
similar to the exponent values for REM sleep. 

In summary, we analyzed, for healthy subjects, interbeat 
interval fluctuations during different sleep stages which are 
associated with different brain activity. We find that the 
short-range anticorrelations in the sign of the increments are 
stronger during deep sleep, weaker during light sleep, and 
even weaker during REM sleep. In contrast, the magnitude 
of the increments is long-range correlated with a larger expo- 
nent during REM sleep, suggesting stronger nonlinear contri- 
butions to the heartbeat dynamics in this stage compared with 
weaker nonlinear contributions in the non-REM stages. 
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FIG. 1. (a) One-night record for a healthy subject. The inter- 
mediate wake states as well as REM sleep, light sleep, and deep 
sleep stages have been determined by visual evaluation of brain, 
eye and muscle activity (b) Heartbeat intervals n, increments 
Sri = n — Ti-i, signs of the increments sgn(<5r;), and absolute 
increments \Sri \ for a subset of the record shown in (a). 
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FIG. 2. The normalized fluctuation functions F(n) /n of the inte- 
grated series of signs s, (a) and magnitudes m; (b) of the heartbeat 
increments for a representative healthy subject, n is the time scale in 
beat numbers. Before applying the DFA2 the profiles have been split 
according to the sleep stages. The fluctuation functions for the seg- 
ments corresponding to the same type of sleep have been averaged 
with weights according to the number of intervals in each segment. 
The different symbols correspond to the different sleep stages, light 
sleep, deep sleep, and REM sleep. 



1.8 

«>1.6 

a 

3 1.4 
1.2 

c 

f 1.0 
0.8 



: I 
i 






1 




- 1 

: 1 


< 


> 


1 


V 


wake 


REM 


light 


deep 



FIG. 3. The average values of the fluctuation exponents a mag for 
the magnitude series and a s j gn for the sign series for the different 
phases (wake state, REM sleep, light sleep, and deep sleep). For 
each of the 24 records from 12 healthy subjects the corresponding 
2nd order DFA fluctuation functions F(n) have been fit by Eq. (4) in 
the range of 8 < n < 13 and 11 < n < 150 heartbeats for a s i gn and 
amag, respectively, where the most significant differences between 
the sleep stages occur. 
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FIG. 4. The values of the effective fluctuation exponents a for the 
integrated sign series (a) and the integrated magnitude series (b) are 
shown for all 12 healthy subjects (second night of recording). While 
the a values are fluctuating, for REM sleep the a is larger than the 
a for light sleep, which is larger than the a for deep sleep (the 3 
arrows indicate the cases which are not ordered in the same way as 
the majority). The exponent values have been determined over the 
fitting ranges as described in the caption of Fig. 0. 
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